Graph polynomials and approximation of partition functions with Loopy Belief Propagation

نویسندگان

  • Yusuke Watanabe
  • Kenji Fukumizu
چکیده

The Bethe approximation, or loopy belief propagation algorithm, is a successful method for approximating partition functions of probabilistic models associated with graphs. Chertkov and Chernyak derived an interesting formula called “Loop Series Expansion”, which is an expansion of the partition function. The main term of the series is the Bethe approximation while the other terms are labeled by subgraphs called generalized loops. In our recent paper, we derive the loop series expansion in form of a polynomial with coefficients positive integers, and extend the result to the expansion of marginals. In this paper, we give more clear derivation of the results and discuss the properties of newly introduced polynomials.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A Lower Bound on the Partition Function of Attractive Graphical Models in the Continuous Case

Computing the partition function of an arbitrary graphical model is generally intractable. As a result, approximate inference techniques such as loopy belief propagation and expectation propagation are used to compute an approximation to the true partition function. However, due to general issues of intractability in the continuous case, our understanding of these approximations is relatively l...

متن کامل

Loopy annealing belief propagation for vertex cover and matching: convergence, LP relaxation, correctness and Bethe approximation

Abstract—For the minimum cardinality vertex cover and maximum cardinality matching problems, the max-product form of belief propagation (BP) is known to perform poorly on general graphs. In this paper, we present an iterative annealing BP algorithm which is shown to converge and to solve a Linear Programming relaxation of the vertex cover problem on general graphs. As a consequence, our anneali...

متن کامل

Approximating the Permanent with Belief Propagation

This work describes a method of approximating matrix permanents efficiently using belief propagation. We formulate a probability distribution whose partition function is exactly the permanent, then use Bethe free energy to approximate this partition function. After deriving some speedups to standard belief propagation, the resulting algorithm requires O(n) time per iteration and seems empirical...

متن کامل

Solving Non-parametric Inverse Problem in Continuous Markov Random Field using Loopy Belief Propagation

In this paper, we address the inverse problem, or the statistical machine learning problem, in Markov random fields with a non-parametric pair-wise energy function with continuous variables. The inverse problem is formulated by maximum likelihood estimation. The exact treatment of maximum likelihood estimation is intractable because of two problems: (1) it includes the evaluation of the partiti...

متن کامل

Graph zeta function and loopy belief propagation

This paper discusses a link between the loopy belief propagation (LBP) algorithm and the Graph zeta function. The LBP algorithm is a nonlinear iteration to approximate the marginal or posterior probabilities required for various statistical inference, using the graph structure to define the joint probability. The theoretical properties of the LBP algorithm are not easy to analyze because of the...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • CoRR

دوره abs/0903.4527  شماره 

صفحات  -

تاریخ انتشار 2009